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© Video signal mixing device of infrared/visible integrated imaging apparatus. 



© A infrared/visible integrated imaging apparatus 
„ has a video signal mixing device for superimposing 
2 a visible video signal upon an infrared video signal. 

The device has a discriminating circuit (8) setting 
^electrical discrimination between the infrared video 
2 signal having a higher level than the black level and 

that lower than the black level. The visible video 

signal simultaneously outputted with the infrared vid- 
Jvjeo signal having the higher level is practically cut off 

with a visible video signal selecting circuit (9). The 
® partially cut off video signal is superimposed on the 
Q. thermal video signal. The level of both video signals 

ar e controllable independently of each other. 
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VIDEO SIGNAL MIXING DEVICE OF INFRARED/VISIBLE INTEGRATED IMAGING APPARATUS 



FIELD OF THE INVENTION 

The present invention relates to an 
infrared/visible integrated imaging apparatus for 
composing an infrared image with a visible image, 
in particular, it relates to a video signal mixing 
device employed in the imaging apparatus for 
superimposing a visible video signal produced by a 
visible camera upon an infrared video signal pro- 
duced by an infrared camera. 



DESCRIPTION OF THE RELATED ART 

Infrared radiation is produced by any object 
having a temperature. Since the infrared radiation 
is not visible to the human eye, detection thereof 
requires some physical device such as thermog- 
raphic system in which an infrared camera, in con- 
junction with an image processing devices, con- 
verts the invisible infrared radiation to a voltage 
signal which can be viewed directly on a television- 
like display. The thermographic system has a wide 
range of application. For example, in a monitoring 
system for monitoring extensive areas, suh as an 
electric power generating station or a liquefied nat- 
ural gas (LNG) storage facility, using infrared cam- 
eras, very small changes in temperature in the field 
of view of the cameras can be detected and dis- 
played on a monitor screen. This monitoring sys- 
tem is applicable to detect a hot spot, namely, a 
portion with unusual change of temperature which 
may indicate an early stage of an accident in the 
extensive area. 

In such a monitor system, there is widely used 
an infrared/visible integrated camera which com- 
bines infrared and visible camera functions. An 
object to be monitored is viewed along a common 
optical axis for both infrared and visible observa- 
tion. This makes it possible to display a composite 
image composed of visible and infrared images at 
desired brightness proportions on the same screen. 
This setup provides more accurate information 
where the trouble is and how bad it is, than sys- 
tems separately using a visible camera and an 
infrared camera. In order to electrically combine an 
infrared image signal (hereinafter an infrared video 
signal) with a visible image signal (hereinafter a 
visible video signal) to form a composite picture, a 
video signal mixing device is indispensable. 

Such an infrared/visible integrated imaging ap- 
paratus is disclosed, for example, in Unexamined 
Japanese Patent Applications No. 52-26268, pub- 
lished on February 26, 1977, proposed by Y. 
Nakayama, or in No.60-35882, published on Feb- 



ruary 23, 1985, proposed by Y. Okumura. 

Fig.1 is a block diagram illustrating an example 
of prior art video signal mixing devices. An infrared 
camera 1 and a visible camera 2 output an infrared 

5 video signal and a visible video signal respectively 
with respect to the same object (not shown) to be 
observed. Both cameras 1 and 2 are arranged at 
positions adjacent to each other to have a common 
optical axis along which the cameras are focused 

w to the object. The signal levels of the outputs from 
both cameras are adjusted through an infrared vid- 
eo signal level adjusting circuit 3 and a visible 
video signal level adjusting circuit 4 with a single 
control using ganged variable resistors disposed in 

75 a level control circuit 6, following which, both video 
signals are added to each other through a mixing 
circuit 5, being converted to a composite signal, 
which is displayed as a composite image of the 
object on the screen of a TV (television like) moni- 

20 tor 7. 

in general, the brightness of an image dis- 
played on the screen of a TV monitor, is propor- 
tional to the input level of a video signal applied to 
the TV monitor, A video signal at a high level 

25 exceeding a threshold voltage, which is standard- 
ized to be 1 volt in Japan, results in an image with 
an excessive brightness, namely a whitish image. 
The brightness of the image is saturated with re- 
spect to a video signal having a further higher level 

30 exceeding the threshold voltage. Hence, the peak 
level of any video signal should be restricted below 
the threshold voltage. In contrast, a video signal 
having a substantially low level, produces a dark 
image. A specified voltage below which the re- 

35 suited infrared image on the screen is invisible, 
namely a black image, is referred to as a black 
level. The black level is usually variable and is set 
to meet the requirement of the user of the appara- 
tus. 

40 In the imaging apparatus, all the infrared im- 

ages and visible images displayed on the screen of 
the TV monitor 7, are produced by video signals 
being scanned line by line like a typical television 
display. Fig.2(a) to Fig.2(c) are diagrams illustrating 

45 the waveforms of video signals at different points of 
the block diagram of Fig.1 . The diagrams illustrate 
waveforms of infrared and visible video signals for 
controlling an electron beam of a TV tube (a cath- 
ode ray tube) of the TV monitor 7, to repeatedly 

so sweep the beam across the screen of the relevant 
TV tube. In the diagrams, the video signal level is 
taken on the coordinate and the signal transmission 
time for horizontal scanning is taken on the ab- 
scissa. One horizontal scanning time interval is 
represented by H. Fig.2(a) shows an infrared video 
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signal 30 outputted from the infrared video signal 
level adjusting circuit 3. The infrared video signal 
30 is composed of a horizontal synchronizing sig- 
nal 31, an infrared profile signal 32 indicating a 
high temperature portion of the object, and a black 
level signal 33 indicating a substantially low tem- 
perature portion of the object. Fig.2(b) shows the 
waveform of a visible video signal 40 outputted 
from the visible video signal level adjusting circuit 
4. The visible video signal 40 contains a horizontal 
synchronizing signal 41 , and a visible profile signal 
42 indicating an ordinary optical image of the ob- 
ject. Fig.2(c) shows the waveform of a composite 
signal 50 outputted from the mixing circuit 5, being 
composed of a horizontal synchronizing signal 51, 
and a composed profile signal 52. 

Both infrared video signal and visible video 
signal are simply superimposed with each other, 
making the above-described composite signal 52 of 
Fig.2(c). The peak level of the composite signal 52 
is required to be limited below the threshold volt- 
age to achieve a clear and bright image favorable 
to be observed. As the result, the level of each 
infrared video signal 30 and that of the visible 
video signal 40 are further restricted, causing un- 
desirable image as described later. 

The level control circuit 6 including the ganged 
variable resistors has an advantage that the com- 
posite signal 50 composed of an infrared video 
signal 30 and a visible video signal 40 never ex- 
ceed the threshold voltage, which is described 
next. 

Ftg.3 is a video signal level chart representing 
the feature of the level control circuit 6 of Rg.1 . In 
the figure, the set position of the knob, namely 
rotation angle of the knob, of the ganged variable 
resistors, is taken on the abscissa, being indicated 
by rotation scales from o to § , and the video 
signal level applied to the TV monitor 7 in the unit 
of volt on the coordinate. It is assumed herein that 
the level of both of the infrared video signal 30 and 
the visible video signal 40 are taken maximum, 
namely equal to the threshold voltage. The dotted 
line shows the level of the infrared video signal, 
and the solid line the level of the visible video 
signal. It is easily understood by observing Fig.3, 
that the sum of both output signal levels is always 
equal to the threshold voltage, and does not ex- 
ceed over the threshold voltage at any rotating 
scale where the knob of the variable resistor is 
positioned. This is a favorable feature of the video 
signal mixing device of prior art shown in Fig.2. 

In practice, the increase in the brightness of 
the infrared image is followed by the decrease in 
that of the visible image and vice versa. This may 
be advantageous to select a favorable contrast 
between the infrared image and the visible image 
in the composite image. However, the ranges of 



the levels of the infrared video signal and the 
visible video signal are undesirably limited respec- 
tively within a narrow signal level range such as a 
half of the threshold voltage. This results in that all 

5 of the infrared, visible, and composite images are 
left vague to some degree, thus distinct recognition 
of images of the unusual points in the field of view, 
becomes difficult to be detected. The cause of the 
above problem lies in the mechanism that the 

w infrared image is simply mixed, or added, with the 
visible image. 

In view of the above described defect of the 
prior art device, there has been expected a devel- 
opment of an improved infrared/visible integrated 

75 device capable of . displaying a more clear and 
distinct composite image. 

SUMMARY OF THE INVENTION 

20 

The object of the present invention is to pro- 
vide an improved imaging apparatus that displays a 
clear composite image composed of an infrared 
image of hot spots of an object to be observed and 
25 a visible image of the object simultaneously. 

The another object of the present invention is 
to provide a video signal mixing device employed 
in the infrared imaging apparatus, by which the 
levels of an infrared video signal and a visible 
30 video signal are adjustable independently, and that 
the infrared image superimposed upon the visible 
image, being displayed on a screen is essentially 
distinct from the visible image displayed as the 
background. 

35 A video signal mixing device according to the 

present invention superimposes a video signal pro- 
duced by a visible camera, upon an infrared video 
signal produced by an infrared camera. The video 
signal mixing device comprises a black level dis- 

40 criminating circuit, a visible video signal selecting 
circuit, and a mixing circuit. The black level dis- 
criminating circuit discriminates the infrared video 
signal having a level below the black level from the 
rest thereof, the visible video signal selecting cir- 

45 cuit selectively extracts the visible video signal 
corresponding to the infrared video signal below 
the black level, and the mixing circuit superim- 
poses the selectively extracted visible video signal 
upon the infrared video signal. 

so The features and advantages of the present 

invention will be apparent by the following descrip- 
tion and claims with reference to the following 
drawings wherein like reference numerals denote 
like parts. 

55 

BRIEF DESCRIPTION OF THE DRAWINGS 
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Fig.1 is a block diagram illustrating a prior 
art video signal mixing device; 

Figs..2 are diagrams illustrating waveforms 
of signals at different points of the block diagram of 
Fig.1; 

Rg.3 is a level chart representing the char- 
acteristics of a prior art level control circuit; 

Rg.4 is a diagram for explaining the basic 
principle of the present invention; 

Figs.5 are diagrams illustrating waveforms of 
signals at different points of the block diagram of 
Rg.4; 

Rg.6 is a block diagram illustrating an em- 
bodiment; 

Figs. 7 are diagrams illustrating waveforms 
of signals at different points of the block diagram of 
Fig. 6; 

Fig.8 is a diagram illustrating the constitution 
of a black level discriminating circuit: and 

Rg.9 is a diagram illustrating a visible video 
signal selecting circuit. 



DESCRIPTION OF THE PREFERABLE EMBODI- 
MENT 

Fig.4 is a diagram for explaining the basic 
principle of the present invention. The video signal 
mixing device of the present invention superim- 
poses a visible video signal of an object to be 
observed, produced by a visible camera 2, upon an 
infrared video signal produced by an infrared cam- 
era 1. The video signal mixing device comprises a 
black level discriminating circuit 8, a visible video 
signal selecting circuit 9, and a mixing circuit 5. 
The black level discriminating circuit 8 discrimi- 
nates the infrared video signal, having a level be- 
low the black level, from the rest of the infrared 
video signal. The visible video signal selecting cir- 
cuit 9 selectively extracts the visible video signal 
corresponding to the infrared video signal below 
the black level t and the mixing circuit 5 superim- 
poses the selectively extracted visible video signal 
upon the infrared video signal. 

Rg.5(a) to Rg.5(e) are diagrams illustrating the 
waveforms of video signals at different points of the 
block diagram of Rg.4. Rg.5(a) shows an infrared 
video signal 60, outputted from the infrared camera 
1 , which is composed of a horizontal synchronizing 
signal 61, a black level signal 63 indicating a low 
temperature portion of the object, and a profile 
signal 62 indicating a high temperature portion of 
the object. The black level discriminating circuit 8 
receives and discriminates the infrared video signal 
60, converting the results into a binary signal 70 
composed of a high level signal 72 and low level 
signal 73 as shown in Rg.5(b). The high level 
signal 72 indicates the presence of a high tempera- 
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ture portion of the object, and the low level signal 
73 indicates the absence thereof. The horizontal 
scanning time interval is indicated by H, while 
duration times in the presence of the black level 
5 signal 63 and the profile signal 62 of the infrared 
signal 60 are respectively indicated by Ho and Hi . 

The visible video signal selecting circuit 9 se- 
lectively extracts parts of a visible video signal 80 
produced by the visible camera 2 during the dura- 

10 tion time Ho, as shown in Rg.5(c), the parts of 
which corresponds to the black level signal 63 of 
the infrared video signal 60. As the result, the parts 
of the visible video signal 80 corresponding to the 
• high level signal 72 of the binary signal 70 are cut 

15 off, and then outputted from the circuit 9 as the 
selected visible video signal 90 having the 
waveform shown in Rg.5(d). 

The selected visible video signal 90 outputted 
from the circuit 9, is superimposed upon the in- 

20 frared video signal 60 in synchronization. The in- 
frared video signal 60 and the video signal 80 has 
been originally synchronized using synchronizing 
signals 61 and 81 respectively contained in both 
video signals 60 and 80 with a conventional tech- 

25 nique. Consequently, a composite video signal 100 
is produced as shown in Fig.5(e), displaying a 
composite image of the object on the screen of the 
TV monitor 7. The composite video signal 100 is 
composed of a horizontal synchronizing signal 101, 

30 an extracted visible video signal 102 superimposed 
upon the black level signal 63 of the infrared video 
signal 60, and a profile signal 105 corresponding to 
the profile signal 62 of the infrared video signal 60. 
In usual, as shown in Rg.5(e), the levels of the 

35 profile signal 105 at the both ends 106 thereof are 
substantially low, leaving a dark outline on the 
fringed portion of the image displayed on the TV 
monitor 7. However, in practice, the dark fringed 
pattern of the infrared image displayed on the 

40 screen is thin. 

An embodiment according to the present in- 
vention is described in detail in the following with 
reference to drawings, Rg.6 to Fig.9. Through all 
the drawings, like numeral reference denote like 

45 parts with respect to the preceding drawings. The 
doubled description of the like parts is omitted. 

Rg.6 is a block diagram illustrating the em- 
bodiment. Reference numerals, 10 anc 11 denote 
buffer amplifiers for amplifying the outputs from an 

so infrared camera 1 and a visible camera 2 respec- 
tively, 12 and 13 denote clamping circuits for delet- 
ing horizontal synchronizing signal and a vertical 
synchronizing signal contained in the output signals 
from the buffer amplifiers 10 and 11. Reference 

55 numerals, 1 4 denotes an optical separator for sepa- 
rating an incident optical ray into an infrared ray 
and a visible ray, 15 denotes a low-pass filter for 
filtering and cutting off the noise components con- 

4 
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tained in the infrared video signal, 16 denotes a 
synchronizing signal separating circuit for extract- 
ing horizontal synchronizing signal and vertical syn- 
chronizing signal contained in the infrared video 
signal, 17 denotes a synchronizing signal adding 
circuit for adding a horizontal synchronizing signal 
and vertical synchronizing signal to the output sig- 
nal of the mixing circuit 5, 18 denotes a buffer 
amplifier, 19 and 20 denote variable resistors used 
in the infrared video signal level adjusting circuit 3 
and the visible video signal level adjusting circuit 4 
respectively, 21 denotes a half mirror, disposed in 
the optical separator 14, for transmitting infrared 
ray and reflecting visible ray, 22 denotes a reflect- 
ing mirror disposed with the angle of 45 degrees to 
the incident visible ray, and 23 denotes an object 
to be observed. It should be noted that the variable 
resistors 19 and 20 are not ganged with the result 
that both video signal level adjusting circuits 3 and 
4 are operated independently of each other. This is 
one of the features of the present invention. 

The operation of the device of Fig. 6 is de- 
scribed with reference to diagrams of Fig.7(a) to 
Fig.7(h), illustrating waveforms of video signals at 
different block stages of Fig.6, being represented in 
the similar manner to those of Fig.5. In the follow- 
ing, description and indication of the elements of 
the video signals such as a profile signal, a synch- 
ronizing signal, and the like, are omitted except for 
those referred in the following description of the 
embodiment, since the elements are quite similar 
to those shown in Fig.5. 

The visible camera 2 has a zoomed lens to 
adjust the size of the visible field of view thereof to 
coincide with that of the infrared camera 1 . Optical 
ray radiated from the object 23, containing infrared 
ray and visible ray therein, is incident on the half 
mirror 21 through which the infrared ray is transmit- 
ted to the infrared camera 1, and by which the 
visible ray is deflected towards the reflecting mirror 
22. which deflects the visible ray again toward the 
visible camera 2. Thus separated infrared ray and 
visible ray are respectively received by the infrared 
camera 1 and the visible camera 2, being con- 
verted to video signals by the cameras. Conse- 
quently, an infrared image and a visible image of 
the object are obtained with respect to co-pos- 
sessed common optical axis and the same field of 
view. 

The infrared signal outputted from the infrared 
camera 1 is subject to impedance matching, and 
amplified up to a predetermined level by the buffer 
amplifier 10. Thus the buffer amplifier outputs an 
infrared video signal 110 shown in Rg.7(a). A pro- 
file signal 112 indicates the presence of a high 
temperature portion, namely a hot spot in the 
object 23. The infrared video signal 110 is inputted 
in the clamping circuit 12 wherein the synchroniz- 



ing signal 111 are removed as shown in Fig.7(b), 
becoming an infrared video signal 120. The signal 
120 is received by the infrared video signal level 
adjusting circuit 3. which is a variable gain am- 
5 plifier. The level of the infrared video signal 120 is 
adjusted to a desired level through the infrared 
video signal level adjusting circuit 3, using the 
variable resistor 19 such that the level of the bright- 
ness of the associated portions at high tempera- 
iq ture, namely the hot spots, of the infrared image 
displayed on the screen of the TV monitor 7 is set 
appropriately. Thereafter, the adjusted infrared sig- 
nal is inputted to the mixing circuit 5. 

While, the infrared signal 110 is also inputted 
75 to the low-pass filter 15 to remove noises contained 
in the infrared signal 110. This is because, if a 
noise is contained in the infrared video signal 110, 
the noise will disturb the subsequent detection of 
the black level of the infrared video signal 110. 
20 Then the filtered infrared video signal 110 is input- 
ted to the black level discriminating circuit 8. The 
circuit 8 is composed of a buffer amplifier 24 and a 
comparator circuit 25 as shown in Fig.8. The re- 
ceived noise-free infrared video signal 110 is com- 
25 pared with a reference voltage Vref taken from the 
Vcc through a variable resistor 26. As shown in 
Fig.7(c), the black level discriminating circuit 8 is- 
sues a binary signal 130 comprising a high level 
signal 132 issued corresponding to the received 
30 infrared video signal 110 having a level higher than 
the reference voltage Vref, and a low level signal 
133 corresponding to that lower than Vref. Using 
the variable resistor 26, the reference voltage Vref 
is set in any voltage corresponding to the black 
35 level required by the user of the imaging appara- 
tus. 

Meanwhile, the visible video signal produced 
by the visible camera 2 is synchronized with the 
infrared signal outputted from the infrared camera 1 

40 with a conventional technology, and similarly am- 
plified by the buffer amplifier 1 1 to output a visible 
video signal 140 shown in Ftg.7(d). The synchroniz- 
ing signal 141 of the visible video signal 140 is 
removed by the clamping circuit 13, being output- 

45 ted as a visible video signal 150 shown in Fig.7(e). 

Fig.9 is a diagram illustrating the visible video 
signal selecting circuit 9 composed of a buffer 
amplifier 27 and a transistor 28. The visible video 
signal 150 is fed to the buffer amplifier 27. The 

so visible video signal 150 outputted from the buffer 
amplifier 27, is turned down to the zero level of the 
visible video signal 1 64, when the high level signal 

132 of the binary signal 130 from the circuit 8 is 
applied to the base of the transistor 28, enabling 

55 the transistor 28. While, when the low level signal 

133 is applied, the transistor 28 is not enabled, and 
the visible video signal 150 is outputted with no 
modification, as indicated by a reference numeral 
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162, to the mixing circuit 5. Consequently, a visible 
video signal 160, having a profile visible video 
signal which is cut off at its center portion as 
shown in Fig.7(f), is produced in the circuit 9. 
Thereafter, the level of the visible signal 160 is 
adjusted to a desired level with the visible video 
signal level adjusting circuit 4, and the adjusted 
infrared signal is outputted to the mixing circuit 5. 

The mixing circuit 5 superimposes the visible 
video signal 160 upon the infrared signal 120 and 
adds both video signals to each other to produce a 
composite signal 170, having no synchronizing sig- 
nal, as shown in Fig.7(g). Vertical and horizontal 
synchronizing signals are selectively extracted from 
the infrared video signal 110 by the synchronizing 
signal separating circuit 16, and are added to the 
composite signal 170 outputted from the mixing 
circuit 5 through the synchronizing signal compos- 
ite circuit 17. The composite signal 170 recovering 
synchronizing signals 181, is finally outputted as a 
composite signal 180 shown in Fig.7(h), amplified 
by the buffer amplifier 18, applied to the TV moni- 
tor 7, and displayed on the screen thereof. 

As described above, the synchronizing signals 
111 and 141 respectively contained in the infrared 
video signal 110 and visible video signal 140, are 
once removed before the superim position of both 
video signals, otherwise the peak value of the hori- 
zontal synchronizing signal and vertical synchroniz- 
ing signal of the superimposed signal are doubled, 
with an undesirable result to the circuit operation of 
the TV monitor 7. 

As described above in detail, in the imaging 
apparatus employing the mixing device according 
to the present invention, the level of both of the 
infrared video signal and the visible video signal 
can be selected within a wide signal level range, 
ranging from the black level to the threshold volt- 
age. This means that the brightness of each of the 
visible image and the infrared image displayed on 
the screen of the relevant TV monitor, is adjustable 
independently of each other, and in full range of 
the image brightness ranging from the uppermost 
brightness (producing a whitish image) to the black. 
As the result, the obtained composite image is 
clear and distinct favorable to detect a portion of 
the object which is unusually at high temperature. 
This realizes the elevation of the capability of pat- 
tern recognition of the composite imaging appara- 
tus. 

Furthermore, the visual image which is usually 
providing a background image with respect to the 
hot spots, can be lowered to a desired lower level, 
if so required, to make the image of the hot spots 
more distinct with clear contrast. This results in a 
quick and easy detection and the location of the 
hot spots. Such adjustment of the brightness of the 
background of the composite image is possible 



BNSDOCID: <EP 0343634A2J_> 



since the level of the infrared video signal and that 
of the visible video signal can be adjusted indepen- 
dently of each other. 

The feature of the present invention observed 

5 in a different aspect namely in the aspect of the 
infrared/visible composite image displayed on the 
screen of the TV monitor. A part of the visible 
image displayed on the screen is selectively cut off 
from the area on the screen where the infrared 

w image having a higher image level (brightness) 
than the black level is present, and the rest part of 
the visual image is superimposed upon the infrared 
image. In addition, the brightness levels of both 
images are independently adjustable of each other. 

is These features of the present invention produce a 
substantial advantage that a clear and distinct im- 
age of the object is obtained. 

The video signal mixing device of Fig.6 is an 
analog device, in which the infrared video signal 

20 and the visible video signal produced by both 
cameras, are analog signals and subject to an 
analog signal processing. However, the infrared 
and visible video signals can be digitally pro- 
cessed. 

25 For example, a digital processing is described 

with respect to a digital device modified from the 
device of Fig.6. The infrared video signal 120 and 
the visible video signal 150 outputted from the 
clamping circuits 12 and 13, are respectively sub- 

30 ject to analog to digital conversion through each 
A/D converter, being converted to digital signals, 
namely digital infrared video signals and digital 
visible video signals. These digital signals are once 
stored separately in each digital storage device. 

35 The digital signals stored in the storage devices 
are digitally processed to form a composite image 
on the screen of the TV monitor 7 employing a 
conventional digital technology. In the digital pro- 
cessing, the black level is represented by a speci- 

40 fied number of the digital signals of the infrared 
video signal. If the number of the digital infrared 
video signals is higher than the specified number, 
then the digital infrared video signals are outputted 
from the relevant storage device, and if the number 

45 of the digital infrared video signals is lower than the 
specified number, then the digital visible video 
signals stored in the relevant storage device are 
outputted. Thus outputted digital infrared video sig- 
nals and the digital visible video signals are subject 

so to digital to analog conversion through conventional 
D/A converters, being converted to an analog in- 
frared video signal and an analog visible video 
signal which are applied to the TV monitor 7, being 
displayed on the screen as an infrared/visible com- 

55 posite image. 

In the above description, the application field is 
limited to a monitoring system for monitoring an 
extensive area. However, the application field is not 

6 
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limited to the monitoring, but applicable to various 
field, for example, to a medical apparatus for de- 
tecting a cancerous growth below the skin of a 
human body. 

The many features and advantages of the 
present invention are apparent from the detailed 
specification and thus, it is intended by the appen- 
ded claims, to cover all such features and advan- 
tages of the apparatus which fall within the true 
spirit and scope of the invention. Further, since 
numerous modifications and changes will readily 
occur to those of skilled in the art, it is not desired 
to limit the invention to the exact construction and 
operation illustrated and described. Accordingly, all 
suitable modifications and equivalents may be re- 
stored to failing within the scope and spirit of the 
invention. 



Claims 

1. A video signal mixing device for superim- 
posing a visible video signal outputted from a visi- 
ble camera (2) upon an infrared video signal out- 
putted from an infrared camera (1) both of said 
cameras being focused on a common object, said 
video signal mixing device comprising: 
a black level discriminating circuit (8) for dis- 
criminating a part of said infrared video signal 
lower than a predetermined black level from the 
rest part of said infrared video signal higher than 
said black level; 

a visible video signal selecting circuit (9) for for 
selectively outputting said visible video signal dur- 
ing the presence of said discriminated part of said 
infrared video signal lower than said black level, 
and selectively cutting off said video signal during 
the presence of said rest part of said infrared video 
signal higher than said black level; and 
a mixing circuit (5) for superimposing said selec- 
tively outputted visible video signal upon said in- 
frared video signal. 

2. A video signal mixing device recited in claim 
1, wherein said visible video signal is outputted 
from said visible camera (2) in synchronization with 
said infrared video signal outputted from said in- 
frared camera (1). 

3. A video signal mixing device recited in claim 
1 or 2, wherein said black level discriminating 
circuit (8) issues a binary signal comprising a high 
level signal indicating the simultaneous presence of 
said infrared video signal having a level higher than 
said black level, and a low level signal indicating 
the simultaneous presence of said infrared video 
signal having a level lower than said black level. 



4. A video signal mixing device recited in claim 
3, wherein said visible video signal selecting circuit 
(9) cuts off said visible video signal during the 
presence of said high signal of said binary signal. 
5 5. A video signal mixing device recited in claim 

1 , further comprising: 

an infrared video signal level adjusting circuit (3) 
receiving said infrared video signal fed from said 
infrared camera (1) and adjusting the level of said 

w received infrared video signal to a level within a 
signal level range ranging from the black level to a 
threshold level at which the brightness of resulted 
image is at maximum: and an invisible video signal 
level adjusting circuit (4) receiving said visible vid- 

75 eo signal fed from said visible camera(2)and ad- 
justing the level of said received visible video sig- 
nal to a level within said signal level range, thereby 
said adjustments of said infrared video signal level 
and said visible video signal level are performed 

20 independently of each other. 

6. A video signal mixing device recited in claim 
1 or 5, further comprising: 

a low-pass filter (15) operatively connected to said 
infrared camera (1) and to said black level dis- 
25 criminating circuit (8),for filtering said infrared sig- 
nal fed from said infrared camera (l)to eliminate 
electrical noises contained in said infrared video 
signal. 

7. An infrared/visible integrated imaging ap- 
30 paratus comprising: 

a TV monitor (7) for displaying a composite image 
of an object to be observed on the screen of said 
TV monitor (7); 

an optical separator (14) for separating optical ray 
35 radiated from said object (23) into an infrared ray 
and a visible ray; an infrared camera (1) focused 
upon said object (23) along an optical axis, receiv- 
ing said infrared ray, and converting said infrared 
ray to an infrared video signal to be displayed as 
40 an infrared image on the screen of said TV monitor 
(7); a visible camera (2) focused upon said object 
(23) along the same optical axis of said infrared 
camera (1), receiving said visible ray, and convert- 
ing said visible ray to a visible video signal to be 
45 displayed as a visible image on the screen of said 
TV monitor (7); 

a video signal mixing means (5) for forming a 
composite signal to display said composite image 
in which said visible image is selectively superim- 
so posed upon a part of said infrared image having 
the brightness level below the black level. 
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© Video signal mixing device of Infrared/visible integrated imaging apparatus. 



© A infrared/visible integrated imaging apparatus 
has a video signal mixing device for superimposing 
£2 a visible video signal upon an infrared video signal. 
^The device has a discriminating circuit (8) setting 
tj" electrical discrimination between the infrared video 
W signal having a higher level than the black level and 
*°that lower than the black level. The visible video 
00 signal simultaneously outputted with the infrared vid- 
^eo signal having the higher level is practically cut off 
W with a visible video signal selecting circuit (9). The 
O partially cut off video signal is superimposed on the 
(^thermal video signal. The level of both video signals 
Ware controllable independently of each other. 
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